support pretrained_to_huggingface functionality for CosyVoice3 RL trainging

Summary

Support pretrained torch model conversion to huggingface model for RL training.

1. Token Design

CV3 folds control tokens into the speech token space and uses an alias map to redirect them. CV2 simply appends them after the vocab.

2. Special Token Vocabulary

CV3 introduces phoneme-level tokens absent in CV2:

• English ARPAbet: [AA], [AE], [AH], [B], [CH] ...
• Mandarin pinyin with tones: [ā], [ǎo], [iāng], [uán] ...
• New system control token: <|endofsystem|>

3. lm_head Construction

4. Input Embeddings

CV2 explicitly copies llm_embedding weights for <|sos|> and <|task_id|> into the input embedding table. CV3 drops llm_embedding entirely and handles everything through the alias mechanism.

5. EOS Token Configuration

CV2 registers three separate EOS token IDs:

eos_token_ids = [offset+6561, offset+6562, offset+6563]

CV3 uses both alias and real IDs as a dual fallback:

llm.generation_config.eos_token_id = [alias_eos_token_id, real_eos_token_id]

Test

GPU: 8 x B200 + Triton reward server (SenseVoice) + Verl + GRPO adv_estimator

- gt_text: 
Nathy is still leading by fifteen thousand! We need one gift to unlock our bonus mission. Who is saving us?, 
- hyp_text: 
nay is still leading by fifteen thousand we need one gift to unlock our bonus mission who is saving us, 
reward_val: 0.851114966376682

Note:

Currently, the WER calculation and reward functions are self-defined. For ASR, we adopt the original SenseVoice implementation from the repository only for demonstration purposes without text frontend regularization. Using Whisper can achieve better performance.